Relevance determination in Learning Vector Quantization

نویسندگان

  • Thorsten Bojer
  • Barbara Hammer
  • Daniel Schunk
  • Katharina Tluk von Toschanowitz
چکیده

We propose a method to automatically determine the relevance of the input dimensions of a learning vector quantization (LVQ) architecture during training. The method is based on Hebbian learning and introduces weighting factors of the input dimensions which are automatically adapted to the speci c problem. The bene ts are twofold: On the one hand, the incorporation of relevance factors in the LVQ architecture increases the overall performance of the classi cation and adapts the metric to the speci c data used for training. On the other hand, the method induces a pruning algorithm, i.e. an automatic detection of the input dimensions which do not contribute to the overall classi er. Hence we obtain a possibly more eÆcient classi cation and we gain insight to the role of the data dimensions.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Relevance Determination for Learning Vector Quantization using the Fisher Criterion Score

Two new feature relevance determination algorithms are proposed for learning vector quantization. The algorithms exploit the positioning of the prototype vectors in the input feature space to estimate Fisher criterion scores for the input dimensions during training. These scores are used to form online estimates of weighting factors for an adaptive metric that accounts for dimensional relevance...

متن کامل

RLVQ determination using OWA operators

Relevance Learning Vector Quantization (RLVQ) (introduced in [1]) is a variation of Learning Vector Quantization (LVQ) which allows a heuristic determination of relevance factors for the input dimensions. The method is based on Hebbian learning and defines weighting factors of the input dimensions which are automatically adapted to the specific problem. These relevance factors increase the over...

متن کامل

The Performance of LVQ Based Automatic Relevance Determination Applied to Spontaneous Biosignals

The issue of Automatic Relevance Determination (ARD) has attracted attention over the last decade for the sake of efficiency and accuracy of classifiers, and also to extract knowledge from discriminant functions adapted to a given data set. Based on Learning Vector Quantization (LVQ), we recently proposed an approach to ARD utilizing genetic algorithms. Another approach is the Generalized Relev...

متن کامل

The Mathematics of Divergence Based Online Learning in Vector Quantization

We propose the utilization of divergences in gradient descent learning of supervised and unsupervised vector quantization as an alternative for the squared Euclidean distance. The approach is based on the determination of the Fréchet-derivatives for the divergences, wich can be immediately plugged into the online-learning rules.We provide themathematical foundation of the respective framework. ...

متن کامل

Computing OWA weights as relevance factors

* On leave of absence from the Department of Electronics and Computers, Transylvania University of Braşov. Abstract – Ordered Weighted Aggregation (OWA) operators represent a distinct family of aggregation operators and were introduced by Yager in [1]. They compute a weighted sum of a number of criteria that must be satisfied. The central element of the OWA operators is that the criteria are re...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2001